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(54) VIDEO DISPLAY DEVICE 

(57)Abstract: 

PURPOSE: To measure the intensity of a viewer of images and to apply 
this measurement result to the control of images. 
CONSTITUTION: A video display device consists of a biological signal 
measurement means which measures the biological signal of a viewer 3, 
a sensibility evaluation means which evaluates the sensibility of the 
viewer 3 based on the signal measured by the biological signal 
measurement means, and an image control means which controls the 
images that are viewed by the viewer 3 based on the intensity of the 
viewer 3 obtained by the evaluation means. An image that is controlled 
by the image control means includes a stereoscopic image in a single 
constitution. Then the biological signal measurement means shows one 
or more of biological signal sensors 4 to 6 which are built into the 
glasses 2 that is externally connected to a video display device 1 . At 
the same time, the sensors 4 to 6 may possibly be identical with a brain 
wave sensor 4, a pulse wave sensor 5 and a skin temperature sensor 6 
or at least one of nictitation sensors 14 and 15. 
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* NOTICES * 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The graphic display device which consists of a biomedical signal measurement means to measure a 
viewer's biomedical signal, a feeling evaluation means to evaluate a viewer's feeling from the measurement 
signal measured by this measurement means, and an image control means that controls the image to which a 
viewer views and listens based on a viewer's amount of feelings obtained by this evaluation means. 
[Claim 2] For said biomedical signal measurement means, the image controlled by said image control means is 
the graphic display device of the claim 1 above-mentioned publication characterized by being one or more 
biomedical signal detection sensors built into the glasses for stereoscopic vision externally connected to said 
graphic display device including 3-dimensional scenography. 

[Claim 3] Said biomedical signal detection sensor is the graphic display device of the claim 2 above-mentioned 
publication which is at least one of an electroencephalogram sensor, a pulse wave sensor, a skin temperature 
sensor, or wink sensors. 

[Claim 4] Said biomedical signal measurement means is the graphic display device of the claim 1 above- 
mentioned publication which is the image pick-up means attached in said front face of a graphic display device, 
and is characterized by picturizing a viewer's wink and making this into a biomedical signal measurement signal 
with this image pick-up means. 

[Claim 5] Said image control means is a graphic display device above-mentioned claims 1, 2, and 3 
characterized by adjusting a cubic effect or displaying the message which stimulates rest based on the amount 
of feelings of the viewer by said feeling evaluation means while changing into a solid image the image to which a 
viewer views and listens from a flat-surface image, or given in four. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to the graphic display device represented with a TV apparatus, 
and relates to the solid graphic display device which has especially become the center of attention recently. 
[0002] 

[Description of the Prior Art] Recently, in the world, the image which has the parallax the object for right eyes 
picturized using two sets of image pick-up means and for left eyes is displayed on the display screen, and the 
solid graphic display device shown so that an image may jump out of a screen to a viewer is attracting attention 
by using a special spectacle or using a special screen. 

[0003] Although the image by which the three dimentional display was carried out has the degree of the 
agitation given to a viewer, impression, stress, and fatigue larger than the usual superficial image, the technique 
which is going to control an image using change of such a viewer's feeling is not proposed until now. 
[0004] 

[Problem(s) to be Solved by the Invention] This invention is accomplished in view of the trouble of this 
conventional technique, the amount of feelings of the viewer who is appreciating the image is measured, and it 
aims at applying the result obtained from measurement to image control. 
[0005] 

[Means for Solving the Problem] This invention consists of a biomedical signal measurement means to measure 
a viewer's biomedical signal, a feeling evaluation means to evaluate a viewers feeling from the measurement 
signal measured by this measurement means, and an image control means that controls the image to which a 
viewer views and listens based on a viewers amount of feelings obtained by this evaluation means. 
[0006] In this case, the images controlled by said image control means as one configuration are one or more 
biomedical signal detection sensors by which said biomedical signal measurement means was built into the 
glasses for stereoscopic vision externally connected to said graphic display device including 3-dimensional 
scenography, and said biomedical signal detection sensor can consider what is at least one of an 
electroencephalogram sensor, a pulse wave sensor, a skin temperature sensor, or wink. 
[0007] Moreover, as another configuration, said biomedical signal measurement means is an image pick-up 
means attached in said front face of a graphic display device, picturizes a viewer's wink with this image pick-up 
means, and can consider what makes this a biomedical signal measurement signal. 

[0008] Furthermore, in the configuration of both above, it is desirable that a cubic effect can be adjusted or the 
message which stimulates rest based on the amount of feelings of the viewer by said feeling evaluation means 
can be displayed while said image control means changes into a solid image the image to which a viewer views 
and listens from a flat-surface image. 
[0009] 

[Example] One example of the graphic display device of this invention is explained to a detail based on a 
drawing below. 

[0010] Drawin g 1 is the top view showing the hardware configuration of the 1st example of the graphic display 
device which the biomedical signal measurement means attached, and 1 is the stereoscopic television 
equipment (henceforth Stereo TV) as a graphic display device, and glasses for stereoscopic vision (henceforth 
solid glasses) with which a viewer's 3 face is equipped with 2 free [ desorption ]. 

[001 1] A viewer 3 can er\joy an image, without displaying the existing superficial image by the normal mode, and 
said stereo TV 1 equipping with said solid glasses 2. Moreover, it makes it possible to display the image for a 
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viewer's 3 right eyes, and the image for left.eyes on the screen of a stereo TV 1 in solid graphic display mode, 
and for a viewer 3 to become possible ['seeing the image for right eyes by the right eye, and not seeing ** and 
the image for left eyes without using said solid glasses 2 by the left eye ], to compound the image included in 
both eyes within a brain, and to experience a cubic effect. 

[0012] And in said solid glasses 2, the sensor 4 which can detect a viewers 3 electroencephalogram, the sensor 
5 which can detect a pulse wave, the sensor 6 which can detect the skin temperature of the regio nasalis, and 
the wink sensors 14 and 15 which detect a blink were formed, and to them, the obtained electroencephalogram, 
a pulse wave, skin temperature, and the detecting signal of a blink are accomplished so that it may be 
transmitted to the direction of a stereo TV 1 through an interconnection cable 7. 

[0013] Moreover, when detecting an electroencephalogram and a pulse wave to this equipment, the required 
reference electrode 16 is formed. It detects that whenever [ impression / at the time of **** ] mentions this 
stereo TV 1 later for a viewer's 3 image, and image control of switching to the 3-dimensional scenography 
which is beautifully [ more ] powerful from a superficial image is performed. 

[0014] Drawin g 2 is the block diagram showing the details configuration of said drawin g 1 . 8 Said 
electroencephalogram, It is the biomedical signal measurement section (sensor section) which consists of a 
pulse wave and skin temperature sensors 4-6. The signal A/D-conversion section from which 9 changes the 
detecting signal (analog signal) from said biomedical signal measurement section 8 into a digital signal, The 
biomedical signal analysis section which analyzes said detecting signal by which 10 was digitized to a biomedical 
signal, the feeling evaluation section which computes whenever [ feeling / of the biomedical signal with which 1 1 
was analyzed to the viewer 3 ], and is evaluated, and 12 are image control sections which control the image of 
Stereo TV by whenever [ feeling / which was evaluated ]. And each part of 9-12 is built in in the stereo TV 1. 
[0015] If actuation of drawin g 2 is explained, biomedical signals, such as an electroencephalogram, a pulse wave, 
and skin temperature, are measured by the biomedical signal measurement section 8, by the signal A/D- 
conversion section 9, a biomedical signal will be incorporated, analysis of the following [ the biomedical signal 
analysis section 10 ] will be performed, and a parameter will be computed. 

[0016] brain : Based on the parameter in each analysis which detected an absolute value and variation and was 
obtained, the amounts of feelings, such as fatigue, are computed [ whenever / agitation ] whenever 
[ impression ] by the feeling evaluation section 1 1, and as compared with the reference level beforehand set up 
in this amount of calculation, if the amount of calculation exceeds this level, an image will be controlled through 
the image control section 12. Wave: Pulse which detects a power spectrum Wave: Skin temperature which 
detects an interval 

[0017] If it explains somewhat in detail about said analysis technique, an independent variable will be chosen as 
the following three kinds, and analysis will be performed. That is, since qualitative correspondence with regio- 
nasalis skin temperature and the amount change of feelings is checked, the quantitive relation of extent which 
is also only regio-nasalis skin temperature is expectable with the data analysis of the regression-analysis 
former which used only regio-nasalis skin temperature for a. independent variable. 

b. It is expected by applying to a variate the frontlet skin tempereture with which reflecting the multiple- 
regression-analysis thermal sensation which used two variates of a regio-nasalis skin temperature frontlet skin 
tempereture for the independent variable is checked that higher correlation is acquired. 

c. It is thought by lengthening the frontlet skin tempereture which carries out a temperature change with 
environmental temperature from the regression-analysis regio-nasalis skin temperature which used the 
difference of regio-nasalis skin temperature and a frontlet skin tempereture for the independent variable that 
the data with which environmental temperature conditions differ can be standardized. 

[0018] The data analysis result of having used the above-mentioned analysis technique for below is shown. 
(1) As a result of the analysis of multiple-regression-analysis aforementioned a-c of regio-nasalis skin 
temperature and a frontlet skin tempereture, and the various amounts of feelings, level of significance is shown 
as each independent variable, the correlation coefficient between [ various ] the amounts of feelings, and an 
assay result of mutually related significance. 
[0019] In said a, it is [0020]. 
[Table 1] 
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[0021] Significant correlation is statistically accepted in regio-nasalis skin temperature, a feeling of recovery, a 
feeling of tension, and a feeling of fatigue (5% or less of level of significance), and it turns out that possibility 
that these amounts of feelings can be presumed from regio-nasalis skin temperature is high. 
[0022] In said b, it is [0023]. 
[Table 2] 
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[0024] significance correlation is statistically found and stopped to regio-nasalis skin temperature and a frontlet 
skin tempereture, a feeling of recovery, a feeling of tension, a feeling of fatigue, and thermal sensation (5% or 
less of level of significance), and it turns out that possibility that these amounts of feelings can be presumed 
from regio-nasalis skin temperature and a frontlet skin tempereture is high. 

[0025] By the way, too much TV appreciation causes a central (cerebrum) activity change while usually 
producing eye strain regardless of an image and 3-dimensional scenography. In this example, this change can be 
detected using said electroencephalogram sensor 4, and it can use for control of an image. 
[0026] That is, as shown in drawing 3 , an electroencephalogram (EEG) is measured by the 

electroencephalogram sensor 4 at step S1. Next, brain activity is computed from the EEG data obtained in step 
S2. This is a step which computes the ratio of the so-called amount of power of an alpha wave (10-1 3Hz), and 
the amount of power of a beta rhythm (14~30Hz) as shown in several 1, and computes the brain activity A. 
[0027] 
[Equation 1] 

A = m'<v-M 

[0028] And brain activity monitor processing is performed at step S3. This processing acts as the monitor of 
the magnitude and the change differential value of A which were calculated by said-one number. The monitor 
situation of this A is shown in drawing 4 . 

[0029] Here, after the condition of becoming beyond the threshold (B) as which the magnitude of said A was 
determined beforehand continues beyond predetermined time (t), suppose that the time of A being less than a 
threshold B, and a change differential value beginning to show monotone reduction is judged with a central 
fatigue condition. 

[0030] If a central fatigue condition is judged, the image processing of step S4 will be started. Here, the viewer 
3 assumes the case where a ******** fatigue condition is judged in 3-dimensional scenography, and this image 
processing means switching an image to the usual superficial graphic display mode from solid graphic display 
mode, or passing the message which demands rest from a viewer 3. 

[0031] Moreover, it is also possible it to be known for that the wink has correlation, to measure eye fatigue with 
CCD camera 1 3 as an image pick-up means by which this wink was prepared in the front face of TV1 by non- 
contact, as shown in the wink sensors 14 and 15 or drawing 5 R> 5 of drawin g 1 , and to control an image by 
that measurement data. 

[0032] The processing actuation in this case is shown in drawin g 6 . First, the wink is measured in step S5. This 
is performed by capturing the image of a viewer's 3 face with said CCD camera 1 3. And an image processing 
extracts an eye field from the image of a face. 

[0033] Next, it progresses to step S6 and wink analysis is performed. This processing is a step which computes 
various parameters in analysis, namely, (**) — wink frequency (time/min) analysis — a parameter PI — 
calculation (**) — the time amount (parameter P2) which the wink pattern analysis took at 1 time of the wink - 
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- The judgment (parameter P3) of the single-engined wink or the running fire wink, wink reinforcement (judged 
by the wrinkle of parameter P4: f for example, a glabella, or fluctuation of a supercilium), the rate and 
acceleration (parameter P5) at the time of wink initiation — calculation (**) — processing of calculation etc. is 
performed by wink spacing property analysis in frequency characteristics (parameter P6) and a nonlinear 
characteristic (Liapunov number) (parameter P7). 

[0034] Next, it progresses to step S7 and calculation of whenever [ eye strain ] is performed. This is a step 

which computes C whenever [ eye strain ] by several 2 based on the parameters P1-P7 computed in the 

preceding paragraph. 

[0035] 

[Equation 2] 

C = f (PI F P2 , ,P7) 

[0036] However, in several 2, f is a function made into parameter P1 - P7 variable. In this way, the data of 
whenever [ eye strain / which was obtained ] serve as criteria of image control of step S8. Namely, if the 
computed fatigue is measured with the level set up beforehand and exceeds this level, an image will be switched 
to superficial graphic display mode from solid graphic display mode like the case of the electroencephalogram of 
point **, or the message which stimulates rest is displayed on a viewer 3. 
[0037] 

[Effect of the Invention] By detecting change of a viewer's various amounts of living bodies like the above 
explanation, this invention is effective in the ability to offer the graphic display device which can always give a 
viewer the image according to the feeling which the viewer individual has received by presuming the degree of 
the feeling received from a ******** image, and performing the image processing to which a ******** image is 
changed by change of whenever [ this feeling ]. 

[0038] And by regarding a viewer's fatigue as change of whenever [ feeling ], the effectiveness it is ineffective 
to it being possible to offer a graphic display device gentle to people is expectable. In addition, by using a 
biomedical signal detection means as a non-contact sensor, it is effective in a biomedical signal being 
detectable, without giving a viewer displeasure. 
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DRAWINGS 



[Drawing 1] 




[Drawing 2] 



(t?v+ 










/ 






/ 




\ 






> 







8 



10 



11 



12 



[Drawin g 3] 
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[ Drawin g 4] 
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